EDITORIAL: Statistical significance, P-values, and replicability
نویسندگان
چکیده
منابع مشابه
The statistical significance filter leads to overconfident expectations of replicability
We show that publishing results using the statistical significance filter—publishing only when the p-value is less than 0.05—leads to a vicious cycle of overoptimistic expectation of the replicability of results. First, we show analytically that when true statistical power is relatively low, computing power based on statistically significant results will lead to overestimates of power. Then, we...
متن کاملClinical significance not statistical significance: a simple Bayesian alternative to p values.
OBJECTIVES To take the common "Bayesian" interpretation of conventional confidence intervals to its logical conclusion, and hence to derive a simple, intuitive way to interpret the results of public health and clinical studies. DESIGN AND SETTING The theoretical basis and practicalities of the approach advocated is at first explained and then its use is illustrated by referring to the interpr...
متن کاملCombining Statistical Tests by Multiplying P-values
A general discussion on combining statistical hypothesis tests is followed by an application involving point source detection in skymaps. The traditional literature on combining statistical tests has concentrated on a regime in which p-values as large as 0.05 are still of interest, and in which it is dangerous to treat tests as truly independent. But for point source detection, very small p-val...
متن کاملThe illusion of power: How the statistical significance filter leads to overconfident expectations of replicability
We show that publishing results using the statistical significance filter—publishing only when the p-value is less than 0.05—leads to a vicious cycle of overoptimistic expectation of the replicability of results. First, we show through a simple derivation that when true statistical power is relatively low, computing power based on statistically significant results will lead to overestimates of ...
متن کاملA statistics primer. P values: probability and clinical significance.
a study of 12-year-old boys evaluating the effect of heading soccer balls and a suspected decrease in cognitive function on standardized tests. The null hypothesis is that there is no difference in cognitive function and the number of times a ball is headed during a season. The research hypothesis is that there is a decrease in cognitive function among players who head the ball on average more ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Applied Statistics
سال: 2021
ISSN: ['1941-7330', '1932-6157']
DOI: https://doi.org/10.1214/21-aoas1500